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RELATED APPLICATION DATA 
[0001] The present application is related to efo-pending and commonly owned U.S. Patent 
Application No. 09/830,480, INTERNET BASED HEARING ASSESSMENT METHODS, 
invented by Menzel et al.; filed 26 ApriL2f001; and to co-pending and commonly owned U.S. 

Patent Application No. , SYSTEM AND METHOD FOR REMOTELY 

CALIBRATING A SYSTEM FQ^ADMINISTERING INTERACTIVE HEARING TESTS, 
invented by Menzel, et. al; fibaon the same day as the present application. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention relates to methods and systems for remotely administering 
hearing tests, in which the subjects of the test use consumer electronic equipment coupled to 
communication media, such as Internet connected personal computers, cell phones, personal 
digital assistants, personal audio equipment, and the like, for the generation of stimuli during the 
test. 

Description of Related Art 

[0003] Hearing tests are used to develop hearing profiles of persons, which can be used for 
fitting hearing aids and for other diagnostic purposes. Professional audiologists are typically 
required for conducting the tests needed to provide a hearing profile, because of the large 
number of factors involved in making an assessment necessary for generating a reliable hearing 
profile. An audiologist is able to set up a controlled environment, and conduct the test according 
to a testing protocol involving a number of stimuli and response steps that is adapted based on 
the responses gathered during the test. 
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[0004] The hearing profiles of individuals vary in a number of ways. The ability to hear 
sounds varies with frequency among individuals across the normal audio frequency range. Also, 
the dynamic range varies among individuals so that levels of an audio stimulus that are perceived 
as soft sounds and levels of an audio stimulus that are perceived as loud sounds differ from 
5 person to person. Standard hearing tests are designed to produce an audiogram that characterizes 
such factors as frequency, sensitivity and dynamic range in the hearing profiles of individuals. 
There are also other factors that affect a hearing profile. For example, psycho-acoustic factors 
concerning the manner in which a person perceives combinations of normal sounds affect the 
ability to hear in ways that can vary from person to person. Also, environmental factors such as 
10 the usual listening environment of a person (library, conference room, concert hall) and the 

equipment on which the sound is produced (loud speakers, ear phones, telephone hand set) are 
□ important. In persons wearing hearing aids or using other assistive hearing devices, the type of 
aid or device affects the hearing profile. The physiology of an impairment suffered by the 
individual may also be an important factor in the hearing profile. 
S [0005] The hearing profiles of individuals have been applied in the hearing aid field for 
[q customizing and fitting hearing aids for individuals. See, for example, U.S. Patent No. 

4,731,850 entitled PROGRAMMABLE DIGITAL HEARING AID SYSTEM, invented by Levitt 
et aL; and U.S. Patent No. 5,848,171 entitled HEARING AID DEVICE INCORPORATING 
SIGNAL PROCESSING TECHNIQUES, invented by Stockham, Jr. et al. Thus, techniques for 
26? processing sound to offset variations in hearing are well known. However, these techniques are 
unavailable to persons not using hearing aids. Furthermore, many persons who could benefit 
from such processing are not in position to use hearing aids for a variety of reasons. 
[0006] A variety of uses for hearing profiles^ther than for the purposes of prescribing 
hearing aids and assistive listening devices, is/5eing developed. For example, hearing profiles of 
individuals can be utilized for producing customized audio products, such as pre-recorded music 
that has been modified according to the faring profile of the listener. One medium for 
delivering customized audio product^is the Internet, See, co-pending U.S. Patent Application 
No. xxxx, entitled SOUND ENHANCEMENT FOR MOBILE PHONES AND OTHER 
PRODUCTS PRODUCING PERSONALIZED AUDIO FOR USERS, invented by Rader, et al. 
30 filed xxxx (RXSD 1 009- 1 ); j&id co-pending U.S. Patent Application No. 09/464,036, entitled 

SYSTEM AND METHOD FOR PRODUCING AND STORING HEARING PROFILES AND 
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CUSTOMIZED AUDIO DATA B^SED ON SUCH HEARING PROFILES, invented by 
Pluvinage, et al., filed 15 Dec^ftber 1999. 

[0007] Because of the difficulty in obtaining a hearing assessment test, and for a variety of 
other reasons, many persons who could benefit from devices that would assist their hearing do 
not follow through with obtaining a prescription for such devices. Thus, it is desirable to 
simplify the procedures involved in obtaining a reliable hearing assessment. 
[0008] United States Patent No. 5,928,160 describes a home hearing test system and method 
based on the use of calibrated headphones specially manufactured to support the hearing test 
using home audio equipment. In addition, reference is made to this patent for its discussion of 
background concerning hearing assessment tests in general. However, home hearing assessment 
tests have not achieved commercial acceptance. 
[0009] Some efforts have been made to develop a technique for allowing a web site visitor to 
measure their hearing loss in an efficient and consistent way that is self-administered. (See, web 
sites: "www.handtronix.com," "www.onlinimearing.com," 
"www.rrigelworks.com/Pages/sofhvare/he^ 

"http://weinstein.cncfamilyxom^^ and 
"www.didyouhearme.com.") Some/of these attempts have implemented procedures that are 
similar to if not identical to a clinical audiogram, where a tone is presented and the listener 
responds if they heard the soiuaCd, in a type of yes-no threshold test. Other attempts implement a 
screening procedure where tones are presented and results are based on whether or not you heard 
those tones with no adju^nnent of sound presentation based on user response. 
[0010] The yes-no procedures of the prior art are nm well suited for self-administered 
testing, and web implementation of a hear test demarkis self-administration. One reason is 
because the listener can fake a threshold and pretend that they are better than they really are, and 
yes-no procedures are susceptible to user bias./The prior art tests that do not adaptively find a 
hearing threshold are crude screeners that dp not provide significant information about the 
person's hearing loss. The prior art tests -that adapt the stimulus based on user input, also use 
basic yes-no procedures. Thus the resmt is determined based on analysis of yes responses and no 
responses to a sequence of queries./See, e.g., ANSI S3. 21 - 1978, "Methods for Manual Pure- 
Tone Threshold Audiometry," a^d the description of computer controlled Bekesy Audiometry in 
ANSI S3. 6- 1996, "Specification for Audiometers." 



r J 

RXSD 1014-1 



• 



[0011] More sophisticated testing algorithms are known which use standardized 
psychological procedures which improve the reliability and repeatability of the hearing loss 
measure, but such algorithms have not been applied in uncontrolled environments, like the 
internet. See, Levitt H., "Transformed up-down methods in psychoacoustics," J Acoust Soc Am. 
5 1971 Feb;49(2):Suppl 2:467+; Edwards BW, Wakefield GH. "Small sample statistical analysis 
of Levitt f s adaptive psychophysical procedure," J Acoust Soc Am 1988 Apr 85, Sl:121; 
Schlauch RS, Rose RM. "Two-, three-, and four-interval forced-choice staircase procedures: 
estimator bias and efficiency," J Acoust Soc Am. 1990 Aug;88(2):732-40; Green D., "A 
maximum-likelihood method for estimating thresholds in a yes-no task," J Acoust Soc Am., 

10 April 1993, 93: 2096-2105; and Green D., "Maximum-likelihood procedures and the inattentive 

q observer," J Acoust Soc Am. 1 995 Jun;97(6):3749-60. 

% jf [0012] As the Internet gains popularity, and more individuals obtain the general-purpose 
s 4 processing power of personal computers coupled to the Internet and having sound cards or other 
r j audio processing capability, the Internet is becoming a more important medium for the delivery 
If of audio products. Accordingly, it is desirable to leverage the communication technology the 
3 Internet used in the delivery of audio products for the purposes of performing hearing 

? =7 assessments in the home. 

C3 SUMMARY OF THE INVENTION 

20 [0013] The present invention provides a technique allowing a web site visitor, or other user 
of a consumer electronic device that is remote from a hearing test server, to measure their 
hearing loss in an efficient and consistent way which is self-administered, and to store the 
measurements as a hearing profile which can be used for customizing audio products. 
[0014] In one embodiment, the invention is a method for conducting a hearing test using a 

25 computer program. The method includes establishing a communication channel between a 
remote device and server in a communication network. A first component of the computer 
program is executed on the server, and a second component of the computer program is executed 
at the remote device. The computer program according to the invention comprises a routine to 
manage interaction via an interface on the remote device, and adaptively select stimuli based 

30 upon said interaction to be produced at the remote device according to a convergent process to 
determine a hearing characteristic. The interaction comprises an N-alternative forced choice 
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interaction in one embodiment. The convergent, adaptive process comprises a staircase function 
or a maximum likelihood function in alternative embodiments of the invention. 
[0015] In one embodiment, the routine to manage the interaction includes a process that 
causes a visual effect, such as displaying a graphic construct on a web page at the remote device, 
which corresponds to each of N alternative stimulus intervals, causes generation of a selected 
audio stimulus during one of the N alternative stimulus intervals, and prompts the test subject to 
make a choice by selecting a visual effect indicating the user's perception of the stimulus during 
the chosen one of said N alternative stimulus intervals. In various embodiments, the number N 
falls in the range of 2-4, for example. 

[0016] In combination with the interaction procedure, a convergent, adaptive tracking 
process is provided for the purposes of selecting the stimulus to be presented during test. In one 
embodiment, the convergent process comprises selecting an initial audio stimulus in response to 
a baseline threshold which has been established for a remote device, producing a subsequent 
stimulus that is reduced magnitude by a step down amount if the response in the interaction 
identifies a correct interval a number X times, or causing the device to generate stimulus that is 
increased in magnitude by a step up amount if the response in the interaction identifies an 
incorrect interval a number Y times. In one embodiment, the number X is 3 and a number Y is 
1, for a 3 down, one up process. Preferably, the number X is in the range of 2-6, and the number 
Y is in the range of 1-4. However, these parameters of selected based upon the characteristics of 
the test the executed. 

[0017] In another embodiment, the convergent adaptive tracking process further includes a 
technique for adjusting the step up and step down amounts. Thus, in one embodiment after a 
number A of reversals of direction of the step direction, the process produces a subsequent 
stimulus that is reduced in magnitude by second downward step amount if the response in 
interaction identifies a correct interval a number X times, or produces a subsequent stimulus that 
is increased in magnitude by second upward step amount if the response in the interaction 
identifies an incorrect interval a number Y times. In this embodiment, the either one or both of 
second downward step amount is less than the first downward step amount, and the second 
upward step amount is less than the first upward step amount. 

[0018] According to various embodiments of the present invention, the remote device 
communicates with the server via a packet switched network, such as the Internet, which may 
establish links via wired or wireless communication media. Also, the remote device may 
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communicate with the server via a cellular telephone network, a pager network, or any of a 
variety of communication technologies. 

[0019] Also, according to various embodiments of present invention, the remote device 
comprises a mobile phone, a home computer, a hand-held computing platform, or other 
consumer electronics devices, such as home stereo or television equipment. 
[0020] The present invention also provides an apparatus that comprises a data processor, a 
communication interface and memory which stores instructions in a form readable and 
executable by the data processor. The instructions specify processes which establish a 
communication channel with a remote device via the communication interface, and manage 
presentation of interaction with the test subject via an interface on the remote device, while 
adaptively selecting stimuli based on said interaction to be produced at the remote device 
according to a convergent process to determine a hearing characteristic. The data processor in 
this embodiment of the invention acts as a server which manages hearing tests remotely, 
enabling test subjects to self administer the tests using a variety of consumer electronic devices. 
In one embodiment, the apparatus comprises routines for downloading software components to 
the remote device for use during the interaction. 

[0021] In yet another embodiment, the present invention provides a method for remotely 
testing hearing using a consumer electronics device which has a communication interface, an 
audio stimulus generator and an input device. The process includes remotely establishing a 
baseline threshold for a control signal supplied via the communication device which causes the 
device to generate a sound. Also, the process involves remotely managing an N-alternative 
forced choice stimulus and response interaction with the test subject. Also, the method includes 
adaptively producing signals to produce selected stimuli at the remote device for said interaction 
according to the convergent process that is based upon said baseline threshold and said 
interaction to determine a hearing characteristic. 

[0022] Thus, the present invention enables remote, self-administered hearing tests managed 
using communication technology such as the Internet and a variety of consumer electronics 
devices as a test terminal. 

[0023] Other aspects and advantages of the present invention can be seen on review of the 
drawings, the detailed description, and the claims which follow. 
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BRIEF DESCRIPTION OF THE FIGURES 
[0024] Fig. 1 illustrates an Internet based system for conducting a hearing assessment test 
according to the present invention. 

[0025J Fig. 2 is a flow chart illustrating the method of operation for an Internet based test 
5 according to present invention. 

[0026] Fig. 3 provides a perspective of a variety of consumer electronic devices at which test 

subjects may take hearing tests according to the present invention. 

[0027] Fig. 4 illustrates signals generated for a three alternative forced choice step. 

[0028] Fig. 5 illustrates signals generated for a two alternative forced choice step. 
10 [0029] Fig. 6 illustrates a process flow for a convergent staircase procedure used with one 
™ embodiment of the present invention. 

%Q [0030] Fig. 7 illustrates a basic calibration set up used with one embodiment of the present 
Hj invention. 

f 2 [0031] Fig. 8 is a plot showing mixer levels during the calibration procedure in one 
t £ embodiment of the present invention. 

s [0032] Fig. 9 is a plot showing management of signal levels during a calibration process in 

?*% one embodiment of the present. 

^ [0033] Figs. 10A and 10B together provide a flow chart for a testing procedure in one 
O embodiment of the present invention. 

20 [0034] Figs. 1 1-24 are images of web pages used for presentation of a hearing test according 
to one embodiment of the present invention. 

DETAILED DESCRIPTION 
[0035] A detailed description of the various embodiments of the present invention is 

25 provided with reference to Figs. 1-24. 

[0036] Fig. 1 illustrates the Internet based system of the present invention implementing a 
hearing assessment test. System includes a hearing test server 10 coupled to a communication 
network 1 1 , such as the Internet. The hearing test server 1 0 executes an interactive, converging 
hearing test protocol, such as the N- Alternative Forced Choice with a staircase convergence 

30 process described herein. A user end station 12, such as a personal computer, is also coupled to 
the communication network 11. The end station 12 includes a sound card 13 which provides 
data processing resources for producing audio output and receiving audio input under control of 
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the logic in computer programs executed by the processor in the end station 12. In the figure, the 
sound card 13 is connected to stereo speakers 14 and 15, or to a headphone, and to a microphone 
16. However, a wide variety of configurations exist in the end stations, which are not in the 
control of the hearing test server. The end station 12 also typically includes a display 19, a 
keyboard 17, and a mouse 18. During the test, audio stimuli in the form of sound signals 
produced in the sound card 13 are generated using the stereo speakers 14 and 15 in this example.. 
The sound signals may be sampled or computed sound. Environmental factors such as 
background noise, and the level of the output of the speakers 14 and 15 could be sensed using a 
microphone 16. The display 19 is used to display a graphical user interface which prompts a 
user to input data using the keyboard 17 or the mouse 1 8 in response to the audio stimuli of the 
test. 

[0037] The hearing test is executed using a computer program that includes a first 
component stored on the server test program memory 20 which is connected to the server 10, 
and a second component which is stored in the PC test program memory 21 which is connected 
to the end station 12. Upon completion of a test, a hearing profile is produced for the user. In a 
preferred system, this hearing profile is stored in a hearing profile database 22 which is 
accessible using Internet 1 1 . In another embodiment, the hearing profile database 22 is coupled 
directly to the server 10. Alternatively, the hearing profile might be stored only on users end 
station and not made available to the communication network. 

[0038] In this example, the end station 12 consists of a personal computer with standard s 
sound card components. In various embodiments, the end station consists of a mobile phone, a 
personal digital assistant, or other consumer electronic device, like home stereo or television 
equipment having the capability to communicate with a remote test server. 
[0039] In one implementation, the hearing test server 10 maintains a web site. To initiate a 
hearing test, a user at the end station 12 accesses the web site and downloads a component (e.g. a 
web page with or without active code, a .wav file that encodes an audio stimulus, or other 
software component) of the hearing test computer program from the server 10 for execution at 
the end station 12. The user initiates the test without intervention by a third party, and uses the 
resources available via the Internet and the resources at the end station to conduct a hearing test. 
[0040] Fig. 2 illustrates the basic flowchart for the process of performing an Internet based 
hearing assessment test. In a first step 50, a user establishes a link between the end station and a 
hearing test server via a communication network such as the Internet. In one example, the link 
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comprises a connection according to the transmission control protocol executing over the 
Internet protocol TCP/IP. The link may also involve protocols like the hypertext throughput 
protocol HTTP, and other Internet protocols. The link may be a wireless link via a cellular 
telephone network or a pager network. 
5 [0041] In a next step 51, test control resources and data processing resources that will be 
utilized during the test are allocated. The allocation of these resources can take a variety of 
configurations, including maintaining all of the resources at the server, and providing an Internet 
based interface accessible using a browser or email client at the end station, maintaining the test 
control resources at the Internet server, and data processing resources at the end station, or other 

10 combinations as suits the particular implementation of the program to control the test and to 

£3 process the data generated during the test. 

% [0042] In step 52, test sound signal resources are allocated. The sound signal resources may 
"--i include sound samples, programs for generating sounds, or other common sound synthesis tools, 
o The sound signal resources are adapted to the particular type of hearing test to be executed. In 
f % one embodiment, the sound signal resources are downloaded to the end station from the server 
f In another embodiment, the sound signal resources are available in the personal computer sound 
. r } card without requiring download from the server, such as by providing recorded audio files with 

drivers for sound cards that are loaded on a user's end station. In another embodiment, sound 
O signal resources are distributed between the end station and a server during execution of the test. 
20 [0043] Next, optionally calibration programs are executed to evaluate the test environment 

(the audio environment in which the end station is situated), and the test set up (the audio 

characteristics of the equipment at the end station) to provide a baseline signal level for the 

device (step 53). 

[0044] Upon completion of the allocation of data processing resources and calibration, test 
25 control resources and sound signal resources necessary for supporting the test, the test is 

initiated. The first step in the test is present an interactive interface to the test subject, including 
visual effects in N intervals, and to generate a sound using the sound signal resource in at least 
one of the intervals (block 54). Next, the process accepts and processes input using the test 
control and test data processing resources, by which the test subject signals a response selecting 
30 one of the N intervals as the one meeting the test criteria , such as whether the test subject heard 
the sound in this interval (block 55). Next the routine determines whether the test has been 
completed, applying statistical analysis of the responses which indicate convergence on a result 
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(block 56). If the test is not completed, then the algorithm determines a next sound according to 
a convergent test protocol (such as a "staircase protocol") using the test control resources, in 
response to the input from the user and the state of the test (block 57). Then, the process loops 
back to step 54 to generate the next sound. If at block 56, it is determined that the test is 
completed, then the hearing profile is stored (block 58). 

[0045] There are numerous options for prompting feedback from a test subjects. Options 
include accepting input in the form of the keystroke, a mouse click, use of a selection button or a 
timeout interval as volume is adjusted by the test control resources, or by the test subject action 
of increasing the volume, until some criterion is reached. A second option for accepting input 
includes causing the user to complete in action prompted by the graphical user interface, 
including graphical constructs which indicate respective test intervals, when test generated 
sounds meet some criterion during the respective intervals. For example, the test sound may be a 
sound varying in loudness. The test subject enters a mouse click when the sound disappears, or 
if it disappears in one of the N intervals. In another example, the test sound is played in one 
interval and not in a next. The test subject indicates the interval in which the sound is heard. 
[0046] The test control resources can be distributed between the server and the end station 
using an Internet link, or using an executable file downloaded from the server and run locally on 
the test subject's equipment, or any partitioning of control in between. By controlling the test 
flow, the program can provide expertise for measuring and evaluating the level of background 
noise, testing for variability in the data, and in general control the flow and pace of the test 
process according to a test protocol. Controlling the test flow has specific advantages toward 
maintaining test subject interest as the user can be prompted to provide appropriate feedback and 
responses. 

[0047] In other embodiments, data collected during the test can be returned to the web site 
server as raw data, as completely analyzed result data such as a hearing profile, or as any 
combination of raw and processed data in between. In one embodiment, data is not returned to 
the web site server in all, but rather completely processed locally on the end station using 
resources downloaded partially or completely from the test server. 

[0048] The sound signals used in the testing process are implement in several alternative 
forms. The type of test signals used can have significant influence on the results of the test 
through a number of psychoacoustic effects. A large number of possible test signals are 
applicable to any of the implementations. Examples of the types of test tones claimed are: 
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Pure tones of long duration and constant intensity in each test step utilizing a number of 
different test steps at different frequencies. 

Pulses of pure tones and constant intensity in each step utilizing a number of different 
test steps at different frequencies. 

Combination of tones of long duration and varying intensity in each test step utilizing a 
number of different test steps at different frequencies. 

Pulses of combinations of tones and varying intensity in each step utilizing a number of 
different test steps at different frequencies. 

Constant amplitude, swept frequency sound in each test step utilizing different test steps 
at different amplitudes. 

Constant amplitude pulses of swept frequency sound in each test step utilizing different 
test steps at different amplitudes. 

Bandpass filtered noise combined with test signals. 

Speech sound with and without noise background with or without temporal compression 
or elongation. 

[0049] Furthermore the method of test sound signal generation is not limited, and can 
include sampling using standard formats like MIDI, FM synthesis, wavetable synthesis or other 
sound generation techniques. 

[0050] As mentioned before, a wide variety of hearing test protocols can be utilized for 
producing a hearing assessment. The particular test chosen depends on a variety of factors, 
including the use to which the hearing profile will be put, the type of equipment used at the end 
station, and any information about the physiology of the test subject which may affect the choice 
of hearing test. Example test types include: 

1) Hearing threshold level. 

The hearing threshold level test is related to identifying the sound level when the test 
subject can just begin to hear the test signal. This test type may be associated with determining 
that actual sound pressure level SPL of thresholds across the frequency range or the test method 
be simply to establish the relative level of thresholds as a function of frequency. 

2) Masking threshold level. 

The masking threshold level identifies the test signal sound level when the test signal 
can be heard out of a masking signal. The masking threshold test protocol can be completed at a 
number of different baseline amplitudes to give an indication of recruitment. This method may 
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have some advantages when there is some background noise at frequencies other than the test 
frequency. * 
3) Loudness matching. 

In a loudness matching method, the generated sound consists of two different 
5 frequencies. One frequency is considered a baseline and is constant throughout a test. The other 
sound, the test sound, has a variable frequency during the test. A measurement consists of 
determining the loudness of the test sound that matches loudness of the baseline sound as a 
function of frequency. The resulting measurements are used to generate an equal loudness curve. 
The difference between the equal loudness curve obtained here and the equal loudness curve for 
10 normal hearing populations gives the hearing loss assessment. This test protocol can be 
m completed at a number of different baseline amplitudes to give an indication of recruitment. 
^3 4) Loudness Growth in Octave Bands (LGOB). 

'~~zA Loudness Growth in Octave Bands is a subjective loudness evaluation procedure in 

f » which the test subject is prescribed set of common adjectives (e.g. very quiet, quiet, comfortable, 
if loud, very loud and uncomfortably loud) to "measure" the loudness of test signals. The 
s difference between the perceived loudness reported by the subject and a population of normally 

hearing individuals gives a measure of recruitment. 
lf m 5) Speech Reception Threshold and Speech Discrimination in Noise or Quiet, 

p These test methods are based oil the fact that different speech sounds have different 

io frequency spectra and so the speech reception/discrimination capabilities of a subject are 

dependent on the subject hearing profile. Furthermore, noise can be used to test the breadth of 
the auditory filter. Tests with background noise are particularly interesting for internet 
administered test because the controlled noise level can be set to mask the environmental noise. 
6) Temporal Masking. 

25 Temporal masking of speech signals or tones can be used to probe auditory 

capabilities since it is known that temporal masking is affected by sensineural hearing 
impairment. 

[0051] The test methods outlined above could be implemented in either a monaural or a 
binaural configuration. In the monaural implementation, each ear is tested individually and the 
30 other ear is "plugged" or otherwise deprived of test signal input. In an implementation scheme 
in which the headphones are supplied, the supplied headphones may have only one speaker. 
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Clearly, there are advantages and disadvantages associated with either test method 
implementation with respect to accuracy and test complexity. 

[0052] The basic test methods outlined above can be implemented within a number of 
different test configurations. The different test configurations may have different peripheral 
equipment, test protocols and they may have different levels of accuracy. 
[0053] Fig. 3 provides a perspective of a variety of other types of remote devices which are 
suitable for use as end stations for hearing tests according to the present invention. A hearing 
test server 30, configured in a preferred embodiment for an N-alternative forced choice test, is 
coupled to the Internet 3 1 or other communication network, and via a wireless link to a cellular 
station or other up link station 32 which may support for example a cellular telephone network 
or a pager network. Mobile phones 33 with or without peripheral devices 34 like headsets and 
microphones, communicate via the up link station 32 with the server 30. A personal computer 
35 may be coupled via the Internet 3 1 to the server 30, and act as an end station for the test. 
Other consumer electronic devices 36, such as stereo equipment or televisions, which are 
equipped for interactive communication via the Internet 3 1 or other types of communication 
networks, are also used as end stations at which test subjects perform the hearing tests of the 
present invention. 

[0054] According to one embodiment of the present invention, an N- Alternative Forced 
Choice Procedure is executed using an interactive interface on the consumer electronic device. 
Forced choice procedures eliminate user bias by forcing the listener to choose between right and 
wrong alternatives. With this, each trial consists of several successive intervals of sound or 
sound presentations. These sound intervals are usually associated with a visual cue that is 
presented during the sound presentation and a visual representation representing each individual 
sound interval. The listener then selects one of the N intervals according to the criterion that 
they have been instructed. For example, they may have been instructed to select the interval that 
has a tone, where the other N-l intervals had no sound. Or they may have been instructed to 
select the one interval that is different from the other N-l intervals. 

[0055] Fig. 4 is a plot of amplitude versus time, that shows tones produced for a 3 -Interval 
Forced Choice where the listener is instructed to choose the interval that is different; here, the 
correct selection is Interval 2 which has a tone that is higher in level than the tones in Interval 1 
or Interval 3. Fig. 5 is a plot of amplitude versus time, that shows tones produced for a 
2-Alternative Forced Choice procedure where the listener has been instructed to select the 
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interval which has a tone in the presence of noise; the correct answer is Interval 2, where Interval 
1 has noise but no tone. 

[0056] A convergent protocol for managing the test in one embodiment is an adaptive 
tracking procedure that meets accepted psychological standards. The adaptive tracking 
procedures described here are well known in the scientific auditory community but have not 
been used in web-based, or other remote hearing-loss measurement procedures. The first 
procedure, known as a staircase function, is an X-Down, Y-Up procedure where for every X 
incorrect responses, the task is made more difficult, and for every Y correct responses, the task is 
made easier. If the task is to detect a tone, X incorrect responses would result in an increase in 
the level of the tone for the next set of trials; Y correct responses would result in decreasing the 
level of the tone for the next responses. Both the correct and incorrect counts are reset to zero 
whenever the X or Y limit is reached. The method adaptively tracks to a specific percent-correct 
threshold, the value of which depends on the values of X and Y. For example, a 2-down, 1-up 
procedure adaptively finds the 70.7% correct point, while a 3-down, 1-up procedures finds the 
79% correct point. This allows different thresholds to be estimated, depending on criterion such 
as number of trials wanted and performance level at which the user should hover around. The 
test continues either until a total number of trials has been reached or a total number of reversals 
has been reached. A reversal occurs for some tests when the adaptive procedure makes the test 
more difficult when the previous change had been to make the test easier, or when the test is 
made easier when the previous change was to make the test more difficult. For example, a 
reversal occurs when the adaptive procedure increases or decreases a sound level when the 
previous change had been in the opposite direction. 

[0057] Fig. 6 is a plot of tone level versus trial number, that shows a run that used a 3-down, 
2-up staircase procedure. Each symbol represents a trial where the listener had either a correct 
(O) or incorrect (X) decision. The abscissa indicates the trial number and the ordinate represents 
the level of the tone that is being adjusted according the listener. Table 1 details each trial of the 
run. 
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Table 1 



[0058] An alternative to the up-down staircase tracking procedure is the maximum 
likelihood Procedure. See, Green, "Maximum likelihood procedures and the inattentive 
observer," J. Acoust. Soc. Am. 97(6), June 1995, pp. 3749-3760. The maximum likelihood 
procedure assumes a form of the psychometric function (for example, percent correct as a 
function of the signal characteristic that is being adapted, such as level of a tone) and calculates 
the most likely psychometric function based on Bayesian statistics. There is the suggestion that 
this procedure is faster than an up-down procedure, but this is still being debated. This 
maximum likelihood procedure has also been applied to yes-know tasks in controlled 
environments. 

[0059] A calibration module according to one embodiment "calibrates" a computer system 
sound card , or other audio resources at the consumer electronic device in a remote site. Fig. 7 
shows the basic calibration concept according to a preferred embodiment. A test subject 60 at a 
remote device 64 produces a self-calibrated sound 62, while the audio resources are used to 
produce a masking signal 63. The calibration module is based on determining the computer 
mixer levels needed for a white noise signal to just mask (masking threshold) a calibration sound 
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generated at the remote site by the test subject. Since the level of the noise generated at the 
remote site will be known within a range, the sound card mixer levels associated with the 
masking threshold will be understood to define a white noise sound pressure level within a 
range. 

[0060] In this procedure, the system drives the mixer slider levels up until a user, through an 
input from the keyboard, indicates that the level of the masker has crossed through the masked 
threshold. Upon this input, the slider levels are automatically driven low, below the threshold 
level and subsequently back up toward a level slightly above the previous reversal. Again a user 
input indicating the threshold crossing, is used to halt the upward travel of the slider level. 
Multiple reversals are used to increase the accuracy of the estimate of the threshold. 
[0061] The user will generate, using common items, a sound called the calibration sound 
(CS). From study of the noises generated, the range of the white noise levels needed to mask the 
sound will also be known. Examples of the specific noise generated, among many possible 
noises, include the following: 

* Striking the keyboard 

* Making circles on a piece of paper with a pencil 

* Rubbing two pieces of paper together. 

[0062] The masker is, in one embodiment, a full band white noise (random numbers 
generated in the time domain). Throughout the calibration module, the presentation of the 
masker will be adjusted through adjustments made, for a personal computer running the 
Microsoft Windows operating system, to the All Wave slider and the Master Volume slider of 
the Windows Sound Card Mixer. These sliders will be adjusted simultaneously. 
[0063] A masking sound of true, fullband white noise is generated through the generation of 
random numbers.. The RMS power will be -5dB bit . The relationship between dBpower and 
dBamplitude for white noise is: 

dBpower=dBamplitude -4.75dB 
[0064] During the presentation of the masker, the presentation level of the masker will be 
modulated according to a predetermined algorithm that uses input from the user. The 
predetermined algorithm includes a ramp-up phase and a test phase. In the ramp-up phase the 
general region of slider position that corresponds to the masking threshold is determined and 
some protections are installed to ensure that the overall sound level can not get to maximum 
slider levels without direction from the user. In the test phase, the sliders are modulated from the 
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reversal point, down below the threshold and then back through the threshold to 50% to 90%, for 
example, of the previous reversal value(s). 

[0065] An effort to avoid allowing the mixer settings of a potentially loud system to be 
driven to their maximum values without user input, the ramp-up phase will include a number of 
regions where the level is not increased without further input from the user. Fig. 8 shows a 
schematic of the ramp-up phase. The various slopes and durations depend on particular 
configurations and design choices. 

[0066] During the test phase, the mixer slider level automatically cycles from above the 
threshold to below the threshold to baclc above the threshold. A new cycle is initiated by the 
user input that indicates that the threshold has been crossed. Fig. 10 is a plot of a mixer level 
versus time, with a trace 70 of the rnasker sound level as it traverses a threshold level 71, and 
reverses after user inputs at times 72, 73, 74 and 75. Specific signal levels and slopes of the 
traces are determined based upon empirical analysis. 

[0067] Embodiments of the present invention apply the principle of auditory masking as a 
basis for setting the output sound level of a remote system. Masking involves a determination of 
when the excitation pattern in the cochlea of the subject caused by the calibration sound is 
drowned out, or no longer sensed, because of the excitation pattern of the masking sound. 
Masking tests are superior to loudness based tests, more objective because the determination of 
whether the calibration sound can be sensed at all is more objective, and thus more repeatable, 
than a loudness comparison in which the subject is asked to state when two sounds have the - 
same loudness. In the calibration method based on masking, the subject finds the masking level 
of a calibration sound, which is self-generated in some embodiments as described above, for a 
computer generated masking sound. In one embodiment, the calibration sound is generated by 
rubbing two sheets of paper together on a flat surface. This sound has good repeatability 
properties across individuals and locations. A masking sound spectrally shaped to match the 
calibration sound is preferred for the following reasons: 

- - Reduced power at masker level. Some systems that previously where unable to 
output sufficient power to mask the calibration sound should now be capable of masking the 
calibration sound. 

- - Reduce potential interactions between hearing loss and calibration sound spectral 
shape on the level set of calibration. 
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[0068] Another feature of the masking noise's spectral content is the affect speaker 
frequency response has on the actual dBSPL/Hz distribution expressed. Measurements indicate 
that the frequency response of typical speakers falls off somewhere above 4khz. This speaker 
response can have implications on the variability of the resulting calibration since the masker 
level will need to be raised artificially high to mask the considerable high frequency energy 
present in the current calibration sound. In this situation, the response of the speakers will, in 
effect be setting the level of the calibration. As a result, it is advantageous to increase the 
spectral energy in the high frequency region so that the high frequency content of the calibration 
sound is masked, even in the face of speaker roll-off, long before the calibration sound 
components below about 4khz. 

[0069] The masking noise is a noise signal used to "drown out" the calibration sound. The 
masking noise is generated by the computer. The factors discussed above are included in 
defining the spectral shape of the masking signal, so that it matches the calibration sound to a 
degree sufficient for a reasonably accurate masking level test. 

[0070] One embodiment of the spectral shape will be defined in terms of dB/Hz. 
Furthermore the spectral shape is specified in terms of normalized values since the overall level 
will be set by the subject. The spectral shape may be defined at a few frequency values. Linear 
interpolation of the dB/Hz values between the given values will be used to determine 
intermediary and limits. Smoothing of the resulting "shape" is not required. Values at or near 
DC are of little consequence since the output of typical computer sound systems at very low 
frequencies is attenuated. One example spectral shape is provided in the Table 2 below. 



Frequency DC 125 250 500 IK 2K 4K 6.3K 8K 10K 13K 20K 
normalized 

<-80dB -18 -18 -18 -12 -6 0 0 0 0 10 10 

dB/Hz 
normalized 

-13 -13 -13 -7 -4.5 0 2.5 2.5 2.5 15 15 

dB/Hz-MAX 
normalized 

-23 -23 -23 -17 -8.5 0 -2.5 -2.5 -2.5 5 5 

dB/Hz-MIN 

Table 2: Spectral Shape of Shaped Masker 
The phase of the signal may be essentially random across the + or - pi range. 
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[0071] As a result of the calibration process, the value of digital signals sent to the computer 
to produce a sound level near that of the calibration sound is determined. This value is 
expressed for example as dB down from a digital maximum level. Thus if the calibration sound 
is known to be about 68 dB, and the value determined by the masking process is about -45dB, 
5 then a sound pressure level that is close to 40dB will be produced by a digital value 
corresponding to -73 dB from digital maximum. 

[0072] Figs. 10A and 10B together show a simplified flow chart of one version of the 
interactive, converging test protocol of the present invention. The test protocol according to one 
embodiment of the present invention finds a hearing threshold level for a set of tones, such as 
10 500 Hz, 1kHz, 2kHz and 4kHz. It begins with a process to establish a baseline signal level for 
£3 the remote device (block 100), using a calibration procedure, such that described above, or other 
Iq calibration procedures which may involve the use of specialized hardware or other techniques for 

direct measurement of sound pressure levels at remote device. Various calibration procedures 
C3 are described in the above referenced related patent application No. 09/830,480, INTERNET 
lg BASED HEARING ASSESSMENT METHODS, invented by Menzel et al., filed 26 April 2001 , 
; which is incorporated by reference as if fully set forth herein. 

£3 [0073] After establishing a baseline, the test resources set an initial stimulus level for a 
iy particular tone in the set of tones to be used in the test (block 101). The initial stimulus level 
;=f may be for example about 30 dB above a typical hearing threshold for a normal hearing test 

20 subject. Next, N-alternative choices are presented in N time intervals, with one interval set 
according to the selected stimulus level, while at the same time presenting visual stimulus 
indicating an interval number to the test subject (block 102). The visual stimulus may be 
provided using a variety of techniques, such as Internet web page "button" constructs presented 
on a display at the remote device, or even simple lights on the remote device, such as LEDs on a 

25 mobile phone. The intervals last in one embodiment between 300 and 700 milliseconds, for 
example about 500 milliseconds. The time between the intervals is preferably less than a 
second, and more preferably about 300 to 700 milliseconds, such as for example, 500 
milliseconds. According to the protocol, input from the test subject is accepted indicating the 
interval number during which the selected stimulus is perceived by the test subject (block 103). 

30 The process determines next whether the responses have reached a stopping criterion indicating 
convergence on a result, such as by determining a percent correct parameter (block 104). If the 
responses have converged, then the algorithm branches to block 105, where the it proceeds to the 
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next tone until all the tones in the hearing test have converged, and the test results are saved. If 
at block 104, it is determined that the responses have not converged, the process proceeds 
through B (block 106) to the process of Fig. 10B. Next, the number of reversals is determined 
(block 107). If the reversal number matches a number A, then the step up and step down 
5 amounts are adjusted (block 108). If the reversal number is more or less than A, or after block 
108, the process determines whether the test subject provided correct response (block 109). If 
the response was correct, then the process determines whether the number of correct responses 
matches X (block 1 10) if the number of correct responses matches X, then the stimulus level is 
decreased by a step down amount (e.g. down by lOdB initially and 5dB after the number A 
10 reversals have been encountered) and the correct response number is reset (block 111). If the 

correct response number is less than X, or after block 111, then the process loops through A 
" (block 112) back to the process at block 102 of Fig. 10A. If at block 109, it is determined that 
v3 the test subject did not provide a correct response, the algorithm determines whether the 
- j incorrect response number matches Y (block 113). If the incorrect response number matches Y, 
15: then the process increases the stimulus level by a step up amount (e.g., up by lOdB initially and 
w 5dB after A reversals have been encountered), and the incorrect response number is reset (block 
i& 114). If the incorrect response number is more than or less than Y at block 1 13, or after block 
12 H4, the process loops through A (block 112) back to the process at block 102 of Fig. 1 OA. 
TU [0074] The parameters A, X and Y in the process of Figs. 10A and 10B can be selected as 
2Ck suits needs a particular testing environment, and of a particular hearing characteristic being 

tested. For a basic hearing profile, X equals a number in the range of 2 to 6, and Y equals the 
number in the range of 1 to 4. For example, the test where X equals 3, and Y equals 1 is useful, 
providing a "three down, one up" convergence process. The parameter A falls preferably in a 
range of 2 to 5 for a basic hearing profile. 
25 [0075] In a preferred embodiment, the parameter X equals 1 , and the parameter Y equals 1 , 
until the first reversal. (One down, one up). Thereafter the parameter X is changed to 3, and the 
parameter Y remains 1 . (Three down, one up). It is found that the initial one down, one up stage 
speeds the convergence process. 

[0076] Also, the adjustment of the step up and step down amounts may be allowed to occur 
30 only once in a given test procedure, or may be allowed to occur many times as suits in the needs 
of a particular process. 
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[0077] As mentioned above, an alternative adaptive, converging process for adaptively 
selecting the stimulus levels, and converging on a result is the maximum likelihood test, in 
which a statistical process is applied to predict a next stimulus level based on a likely threshold 
determined from a set of responses gathered during the test. A single false or erroneous response 
does not cause the program to presume convergence for maximum likelihood algorithm. 
[0078] Figs. 1 1 through 24 are images of web pages generated by a routine that causes 
presentation of an N-alternative forced choice hearing test providing interaction with a 
convergent procedure according to one embodiment of the invention. The web pages are 
rendered by a standard Internet browser, such as Internet Explorer provided by Microsoft Corp., 
in an interaction with the test server. An opening screen for this example is shown in Fig. 11. 
The opening screen of Fig. 1 1 introduces the concept of the hearing profile and explains system 
requirements to a test subject. If the test subject selects the "continue" button on the web page of 
Fig. 11, the page of Fig. 12 is presented, which prompts the test subject to allow downloading of 
a component of the hearing test program from the server for use in execution of the test. In this 
embodiment, the component downloaded comprises a routine, implemented for example as a 
DirectX file, for generating the audio stimulus for the test and calibration processes, for 
managing the interaction during the test and calibration processes, and for adaptively selecting 
the stimulus levels according to a staircase function as described above. The server continues to 
execute a component that maintains communication with the remote site, and reacts to messages 
from the remote site, such as receiving the results of the testing, and interacting with the test 
subject before and after the test. 

[0079] If the test subject selects the "continue" button on the web page of Fig. 12, then the 
component is downloaded, and the web page shown in Fig. 13 is presented. The web page of 
Fig. 13 prompts the user to prepare the speakers and environment for the test. This includes 
instructing the test subject to make adjustments of the audio parameters on the device, such as a 
personal computer, to be used during the test. 

[0080] If the test subject selects the "continue" button on the web page of Fig. 13, message is 
shown to the user that a software component is being downloaded to support the calibration step. 
The component downloaded at this stage is a compressed audio file storing music. When the 
music file is downloaded, the web page shown in Fig. 14 is presented. The web page shown in 
Fig. 14 explains the first step in a calibration process. According to the first step, during 
presentation of the web page, the music file is played in the speakers. Users instructed to adjust 

-21 - 



RXSD 1014-1 



the volume so the music is at a soft, comfortable listening level. If the user successfully 
performs this step, and selects the "y es " button in Fig. 14, then the web page shown in Fig. 15 is 
presented. 

[0081] The web page shown in Fig. 15 explains the second step in the calibration process. 
5 During the second step, the test subject prepares a calibration sound source using ordinary items. 
In this example, the web page explains how to prepare to pieces of printer or copy paper so that 
the process of rubbing, the paper together can be executed to generate a calibration sound. If the 
user presses the "continue" button on Fig. 15, then the web page shown in Fig. 16 is presented. 
[0082] The web page shown in Fig. 16 prompts the test subject to verify that a calibration 
10 sound is being made using the items described in Fig. 15. If the test subject selects the "yes" 
O button in the web page of Fig. 16, then the web page of Fig. 17 is presented. 
-%Q [0083] The web page of Fig. 17 illustrates and explains the process to be used in order to set 
%j a baseline level for the personal computer using the calibration process. Basically, the computer 
U generates a soft, continuous noise. The test subject continuously rubs the paper together, and 
IS decides when the calibration sound is just drowned out by the noise coming from speakers. The 
test subject increases the computer-generated noise by clicking on a button in the screen 
presented during this process, or by using other input devices. Finally, the web page in Fig. 17 
ffj explains that when the computer-generated noise is drowning out the paper rubbing sound, then 

— St 

12 the test subject signals completion of the test by clicking the "continue" button to be presented 
20 during the test. If the user selects the "begin" button shown in Fig. 17, then the web page shown 
in Fig. 1 8 is presented. 

[0084] The web page shown in Fig. 18 is the last step in the calibration process, during 
which the test subject determines the level at which the computer-generated noise drowns out the 
paper rubbing sound. Thus, the web page shown in Fig. 18 prompts the user to begin rubbing on 

25 the paper and adjusting the computer-generated noise using the "up" button, and "down" button, 
until the masking level is reached. When the masking level is reached, then the user is instructed 
to select the "continue" button. The screen includes three indicators, which comprise the 
numerals 1, 2 and 3 within respective circles. When the test is completed a first time, the first 
indicator is highlighted. When the test is completed a second time, the second indicator is 

30 highlighted. When the test is completed the third and final time, the third indicator is 

highlighted. When the test subject selects the "continue" button after the third level setting 
process in the web page of Fig. 18, then the web page of Fig. 19 is presented. 
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[0085] The web page of Fig. 19 represents the start of the N-alternative forced choice test, 
and explains that testing procedure. Thus, the web page of Fig. 19 explains that the test subject 
will be asked to make choices based on tones that he or she hears. In the example shown in Fig. 
19, the test subject is offered the opportunity to run a trial by selecting the "trial" button in the 
web page of Fig. 19. If the user selects the "begin" button in the web page of Fig. 19, then the 
web page of Fig. 20 is presented. The buttons "1" and "2" in Fig. 20 will light up, or otherwise 
be highlighted, for a moment, one after the other. A tone will sound as one of the buttons lights 
up. The task of the test subject is to choose which button lit up when the tone was perceived. 
As the test subject proceeds, the test subject eventually will not be able to hear the tone and will 
have to guess which button goes with the tone. A progress bar keeps the test subject informed 
about progress of the testing. The buttons "1" and "2" are graphic constructs aligned in an up 
and down relationship, rather than a left and right relationship in this embodiment of the 
invention. It is found that the up and down relationship is preferred in environments in which 
test subjects may be mistakenly correlate the left button with a left speaker and the right button 
with a right speaker in a stereo configuration. 

[0086] Using this interface, where the visual indicators of the test intervals comprise 
highlighting of the buttons "1" and "2," the user is prompted through the testing procedure. The 
testing procedure follows a process such as described above with respective Figs. 10A-10B. 
[0087] When the test is completed, either the web page shown in Fig. 21 or the web page 
shown in Fig. 22 is presented. The web page of Fig. 21 is presented if the hearing profile 
produced by the test suggests that the test subject could benefit from personalized audio 
generated by applying hearing profile. In the web page of Fig. 21 , the test subject is prompted to 
playback audio samples which have been adapted according to the hearing profile created using 
the test. The web page of Fig. 22 is presented if the hearing profile of the test subject is within a 
normal range, suggesting that the hearing profile can be applied for personalized audio products 
in a noisy environment, but may not be necessary in a quiet environment. The user is prompted 
to select samples of audio products which simulate a noisy environment in a original format and 
in a optimized format. 

[0088] If the user selects the "continue" button in the web page of Fig. 22, then the web page 
of Fig. 23 is presented. The web page of Fig. 23 allows the user to register with the web site, 
store the hearing profile, and otherwise participate in activity supported for registered users of 
the web site. 
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[0089] When the process is done, the web page of Fig. 24 is presented which acts as a 
closing presentation for the process. 

[0090] The interactive presentation shown in Figs. 1 1 through 24 is adapted for presentation 
using a full function browser in a personal computer with a large format display, and coupled to 
the Internet. In other types of consumer devices, such as mobile phones or personal digital 
assistants, the presentation is adapted to the format of the display available. Also, the types of 
software components that are downloaded from the server to the remote device to support the 
hearing test are adapted to be architecture of the platforms used during the testing process. 
[0091] While the present invention is disclosed by reference to the preferred embodiments 
and examples detailed above, it is to be understood that these examples are intended in an 
illustrative rather than in a limiting sense. It is contemplated that modifications and 
combinations will readily occur to those skilled in the art, which modifications and combinations 
will be within the spirit of the invention and the scope of the appended claims. 
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